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\ An iiTiagc s<;pmc*^ta^iOf) priK«*s, <;*jjn|Jds5ft^ the {bJJowmg st^: 
i) ^gm&ntln^ im lm<^s: into n niaki hiit;ici^i'iL>:iis4 ti Jocai badirgj-mifid 
ajid a fm otjca, whej^m the fct h «n Either JJ^emsn hae^^roumi or tiie locaJ 

2. Tlic: p! ot;£$s >;et Jbrih in d?UTH <^ step a) ftirther c<>juprisijj|j the 

d) c}.^ss<f>ing the Isist ol^titt into tnic cla&ss i\f a group of da^^s 
i:Ofimiki-^ nf mm oh)m, a picture Mm, und a composJtet objca; 

^j) tt the fmx object jsi classified as ij c^ij^pcisate cihii'tt, iileniir^'ing a local 
bitdcj^rcnjj^d for tins ilf objfccl; 

g) ciassfftwg (he ncxi oXiyfici mhy m<i chj^ of a gfciip «f cksKCS 
citirjjiistin^ of it J^xj s psct«re oJ>jea, and a awrsposhe imi&ct; atsd 

h) if (he next iiiie^tt ?s riassitld Jta a aMwpf^iitt^ t?l).jt?t.t perfomistii* s ttjps 

1 , 'i'lifr pim^ess m Ibflfj f» viaiijj 2, step tj) f^iftha cotripiisJii^ iM 

i) fdcfttiiytiig oj>e or more block frf />tK«is m th<Es xiv.z^p., wb^mn ilm 
d^mmc mjnge« of of iH three c?)bf t'hanEiels ajx; tess thfin a };r(?d^!>f^iaed 

adjaa^t j^ixek with ft cdcif <iiJierc5tc*o irinn the unifbrni hJuck }m Xtim « pred^^mmed 
ihteshold arc niajked as betos^^ng to region; 

k> caJculaiiii^ a tn^m coJo? for ^^ch gfinv?t rc^bji; 
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mj icfcfisiiylHSi the- rzmm with im iarg^s? boujidm^g area as ihe mm 
t^ackerouTKl fox iJte ima^e. 

4.. The pfiscess .set fmh h <;l.tJm 2, step c) ^(ther oo-ttiprj$ing the 

1) 5«^jeniitl;^ ihti ottje^i *>U tht; f;;alM backgroitftd 

T\n pr^i^c?;^ set forth m ehim 2, whee^ji ikst c)bject iji 
c^-ja^flijrf S5 $( con^jKJsitt; abi<H:t, skp c) fuflhcf compiuin^^ ihc foilowintE steps: 

I) dixaath^ i<ij^m in the fsist cii^jta; 

j) rej)wv:rjg tlii> cd^i^ pixels tram th?; first t>J}fect, 

fc) api>lyiri^i R ytfgion >^n)w;r^ ;i]gar5thm to e^sch pixd on ih<^ oxsl^it 
boi^nrfiuy of the ft-tt)ovcd echce pj>;<;!s:, vvher^iin ^<^jacerit ^'mH vdih k ct>{cr ditfente 

0 ii^<^«ityiBgthe t^oft xvith the largest boiiinding am; 

nn) cofTip^ant^ ihi^. iiirnefis^*>rt$ oft^te jfv^on to & pictot^fTrafteil 

n) if sh<; dim<?.n?a<;fi$ of tJie Uirj^trxt rt^^cxr. ssre greaicr xbm tiw 
pYi4mmmi\ threshoM, idt«ltiV% -i^^e rejjioa jt.^ |h:e local oacifj^miind Jbi t^ie firsf 
object, cithci'wii-ie, f ecl»)sf§>i:jtg tliii flm objijci a* a lilamv o-bjecfc., 

<r The: pro£:<^$s fiifih in cta'tr?! 2, steps itnii §) frin}m 
a>iiipri}iirtg the Mowing sj^^^jh- 

backgfouftH m ih*^ hodzorujij dktf^^Eion tc se^;ne.Hi tiK^ y^jeci fend cbr«5ijr>'*ng tlie 
ftcxt jfejf a text cl^ii^^M: ji'tJie wittsh of the de^.mx iif^^mM hy the aJgtjrkto k km 
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thaa ^ msisjma^ width, aarf 

I) iipplyinijc A iync^iimm^md J^orj^hok^giOi*;? ai^^orithdu m the: local 
fe^^ekj^a-sumi m tha v'<?f ileal <Jijy*eJion u> segm<jn< ihe r^ext c^ca ajid elassiiVing Uu^ i^cxt 
object as a je?it irrt*c y^4\h i^fihi? tk'Fncat? cleit^5i;tt !jy ihe aJgont?tf« ts IwiS ttisn- 

7, The jyroce^ a^. ilmh in ci^im 2, JiSt>p f) ftartJitw- c(vTttprijiing ihte 
'}) removing the <^dge pixels fwm ihc Um\ b-a^k^^i^mid; md 

J?. An image ^picm^iitiOE] pjt?C€3:si. oDnipj'ijt'ai^ the R>Ek>\Sri?ig sieps: 

h.icSv^oittHl iocal bacitgicund, antJ a first objecJ^ vvhertk ihe first ohjc^t either 
the mini biiickgrtJHrtd m ih^ \vmi h^^i^k^^mmfiy -md 

l>) vt^Mng ihn bf^rders i^Jiarcd^ by any nv^j> of m^Stt b^hmiun^, the 
lCK;<-d batligj'cnjiid, and the ^ir-^t object at ihc cmgifial tC5(?]ijtk?ii of She kamt. 

c) Ii)vV'pss5 (tltering i^nd: tJvXmv^tsn^ ihc image; 

d) ii^t?«tJVij>^ a fiism b;ti?k*^raimd for the image; 

(S) ^^gF.i^w?5% a fij'jtt objecl OR siie mam tatkgrotJSid.: 

0 cksijifvin^ ih6 lu^t d^^^t^s ktc^ on<; c;aji« «f a group of clasjkjs 

v;t-jj;.'fjstTj5g of a test oisjea, a pkniris fjl^jca, ft ci>rti;|K>^itc objwt; 

g) Wxht hst objt-ct ii; c^a,^i.'(fitid iis acoixipcixits; object, iteaiiyi^ng a Jocftl 

bac^^rown<J ihr the fii.'it object: 
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Ci>mi^tt5ig of ie*tt ohjK^u a pkmc ^h]«>L:t And a compomc object; hnd 
g) ihfcwgn r> for tJii- iKr.»(V<ibjsct. 

10. The prm^$ lofth m daim 9, ^^sps e) and f) further 
compjiiibjt tJ)^ foiiowb^g steps: 

k) aj^tyi^ig a c^^K^<Eimef1^::c^^;a^ morphakf^^Citf aljiwriihrn to ma mm. 
hiii^grmtid in ilie honzonta! dkecjiijirt to ssgaiem tJie Jirat objeci md dassfyim* shit 
fivst a^i^i m a ten objieci ihe width mth^ t^km^m dmcud by the %3nthm b kss 
than ft niax«jtaj width; nnd 

) It . The pr^X'-e.ss ^ci tmth m ctHirn <», stfjp h) fimhtr cotxi^^nm^ the 
following sieps: 

resobtton of the iit^agc, 

n) if sjiy |oc-3l bai-fc^^rotttit? h -iegRnci^tc^ and if asy ob>c^: da^siikit 
a picture ob{et:t, r^^Mng t}ife}vi)rte oft^^ch b^ckgrmmi mM-Mi pkiumMm: 

0} {{' mw o^i^a H d^i^M 3^ 5. t«:ct oi^irci, r^tsimig Oks borders and 
im^rkcir of ^iAcb ie?f.t obitjci. 

p} ^^p\ylf.g 3 rc^gion gj^r.viftjs; a^jt0fi?hm io each of tlie pixels akin^ft^ie 
hmim o^^h h>cs3 bjsdcsjmtmii a;^;^ each tnmm object, wtiefHjin adJac^nt j^ix^Js mik 
a a>}of difference fro^Tt the r^jgirtn less tiw; i> pre4ej;cnnf?kirf tohald isri; marked 
bcion^RK to ihe rtgtcjjj 
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i 3 . T]>c proofs Hci ihnh iri xAUm I i . ste^ o) fimher coniprjstng ihe 
fi>nawin^ steps: 

p) ^PP^yn% a rc^^io^i «ro%vjT'j:^ algodt hfft to each pixi't drnji the hcHCfet' 
of each text *>b|i$ct. wlse-rdn a4|3i;*?riJ pjx^^ls vviih a colaf ^fifftitxjsici; Itijm the r^:?^n fes 
than a {nedetcnrirted threshold are mzxka^ bthi^^jx^ to the region; and 

^) i*f»i?ly»J^ R Tiigion t^rowmg algorittitn to c^ch pi\(^ of eitch text CJLvjtfct, 
whcfCHj atijMocm pixels with t color ditTerciKC from the rejjjon les^ ih.m a 
j>ftx1ett?ri?n3Kd threshold are marked m belonging lo tht fijgion. 

\4 The procB^s sei fi^nh In ckim I J , further ti^mpmitiM; ihc 

j>) 4et-evrttmi?)g if the ioca? {jat'ki-;'<iUEii3 j$ a sweep; afid 

a? a picture i>!>j<;t4. 

$) (>,-jj;^putii(ig the mmti milor of each ^>ob--f^:gi.oa; 

c) cLiJisiiyirijr (iit^ intt" i>!io cto K>f a ^jvoup of i^lasses 

e:«BfiLsitng of a ieKt objtjttj, a ?ku»r« tib^^ct, aj^d « CA:siH|H)si£e object: and 

ii) ifL^s firHt o3;jecj is ciA^?i,'ifj?>d as a c^>:>ipc>stite oJ^cci, jdcjjliijr-ing a local 



Application/Control Number: 09/977,186 
Art Unit: 2621 



Page 7 



17. The iv.cthtjtJ st;£ Sinb claim 16, Ivrther compfisirig the 

^> Cthe ftm ohject i& <;^^t^^?iil^t^d M a c<*mposkc object, jilenltfybg a 
s^ond object on the JocM backgrouin! cf fheftrs^ object; 

0 d.3?i;sjfymg iJ,y if;ct,x)ji<| objeict into c^ne ckss of a ^roui> i\t dusses 

lm&\ bfiv.k&ia->wid f<n tfjc ifecoad object 

It The mejhcd forfli m cklm 17, fttfihe?- comjjdsiiig tht 

third ofcjfect tin the kicr;l backf^-oufjd *>f ^h^ seajnd object; 

i) c(?$silmii; Hie thM obl<icx imn ^>«e of it t^^<mp of ck5iscs 
ct>ni?is(m^ Kjratex; o&vject, a piciiire object, and « (composite object; m4 

J) ift^^c tlikd^ object h cLw^iifts^d as s Ci'Mx^osiii^ i^^-,t, Ucnl^ymg s ^oc;s! 
b$ii^k^tomil for ihc i;Mr<^ o?iec.r.. 

\9 llw m^hod set forth m cMm U. ilmhw cci^ipnsii;^ the 

0 dassiYyi/ig r::^e jk^^^Mid obj<«cf kKo Oix? af b jjroup t>f dashes 

g) if the A^nd otyoct ctasHiflit?? a composites oftfieet, McmiiyirKg a 
lociit background fi:jr tfjsj second vii^j^ct. 
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i) tf^5<t^ir>diig jfje ihmi ofcjeci \im vice vt&ss of a ^roup ot clashes 
consisting of a Jextoipct, a f>;esii!'<? i^h^ca, and a compxssite t>b|<ict: and 

b^ckgumtjii for the thir<i object- 
Si. TIk iiieihcKi ,set fmh h dmy 15, furthef cc-njpnsiflg tht 

«) if ihe ^fst object jjs ck^^.:^1^^^^i1 ;if.s a cmipm\K^ t*N<t;i det«Fn)injjjg if ihe 
diniensbns of local tx^^j^j^pyi^td tjf ihe fins* objtci iive gr^;ut<;r ;hnn s prsfict^rmijied 

f) it'tfrn dirr^ension^ are not gw^ter ih^m ihe pie<Jctcft?uoed tbmiholki 
j^jcJaijjtifyirjg Xitt first object ii.pieUtrt^ t^bjeci:. 

Tim meUioU set ftmh m cbin> }o, fertivei* cx?mp?is(ftg iJss 



